AN ARITHMETIC INTERSECTION FORMULA ON HILBERT 

MODULAR SURFACES 



TONGHAI YANG 

Abstract. In this paper, we obtain an explicit arithmetic intersection formula on a 
Hilbert modular surface between the diagonal embedding of the modular curve and a CM 
cycle associated to a non-biquadratic CM quartic field. This confirms a special case of 
the author's conjecture with J. Bruinier in |BYj . and is a generalization of the beautiful 
factorization formula of Gross and Zagier on singular moduli. As an application, we 
proved the first non-trivial non-abelian Chowla-Selberg formula, a special case of Colmez 
conjecture. 



1. Introduction 

Intersection theory and Arakelov theory play important roles in algebraic geometry and 
number theory. Indeed, some of the deepest results and conjectures, such as Faltings's proof 
of Mordell's Conjecture, and the work of Gross and Zagier on the Birch and Swinnerton- 
Dyer Conjecture, highlight these roles. Deep information typically follows from the deriva- 
tion of explicit intersection formulae. For example, consider the Gross-Zagier formula [GZ2J 
and its generalization by Shou-Wu Zhang [Zhl], [Zh2], [Zh3j. We also have recent work 
on an arithmetic Siegel-Weil formula by Kudla, Rapoport, and the author [Kulj . [KRYlj . 
[KRY2j . along with work of Bruinier, Burgos-Gil, and Kiihn on an arithmetic Hirzebruch- 
Zagier formula [BBKj . There are many other famous examples of explicit intersection 
formulae. There is the work of Gross and Zagier on singular moduli |GZlj . the work of 
Gross and Keating on modular polynomials [GKJ, along with its many applications (for 
example, see [Kulj . |KRlj . |KR2j ). as well as the recent results of Kudla and Rapoport 
[KRTJ IKR2j in the context of Hilbert modular surfaces and Siegel modular 3-folds. 

In all of these works, the intersecting cycles are symmetric and are of similar type. 
We investigate two different types of cycles in a Hilbert modular surface defined over 
Z: arithmetic Hirzebruch-Zagier divisors, and arithmetic CM cycles associated to non- 
biquadratic quartic CM fields. These cycles intersect properly, and in earlier work with 
Bruinier [BY] , we conjectured the corresponding arithmetic intersection formula. The 
truth of this formula has applications to a well known conjecture of Colmez which aims 
to generalize the classical Chowla-Selberg formula |Coj . as well as a conjecture of Lauter 
on the denominators of the evaluations of Igusa invariants at CM points |Laj . Here we 
prove a special case of the conjectured formula, and as a consequence we obtain the first 
generalization of the Chowla-Selberg formula to non-abelian CM number fields. This result 
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confirms Colmez's conjecture in this case. It also confirms Lauter's conjecture in certain 
cases, but for brevity we shall omit a detailed discussion. 

We begin by fixing notation. Let D = 1 mod 4 be prime, and let F = Q(y/~D) with the 

ring of integers Op — 7i[ D+ ^ ] and different Of = \/~DOf- Let M. be the Hilbert moduli 
stack over Z representing the moduli problem that assigns a base scheme S over Z to the 
set of the triples (A, l, A), where ( |Got Chapter 3] and |Vot Section 3]) 

(1) A is a abelian surface over S. 

(2) l : Op Ends(v4) is real multiplication of Op on A. 

(3) A : dp 1 -> P(A) = Hom c , F (A, A v ) s y m is a ^-polarization (in the sense of 
Deligne-Papas) satisfying the condition: 

(1.1) &j?®A-tA w , r®a^A(r)(a) 

is an isomorphism (of Abelian schemes). 

Next, for an integer m > 1, let T m be the integral Hirzebruch-Zagier divisors in A4 
defined in |BBK| Section 5], which is the flat closure of the classical Hirzebruch-Zagier 
divisor T m in Ai. For m = 1, 7i has the following simple moduli description. Let £ be the 
moduli stack over Z of elliptic curves, then E y (E £g> Of, <<, A) is a closed immersion from 
£ into Ai, and its image is 7i- 

6 : £> F End 5 (P) ® C F = End 50OF (P <g> £> F ) End 5 (P <g> Op) 

is the natural embedding, and 

A : dp 1 — )■ Hom 50OF (£ ® F , P ® 9 F 1 ) sym , A(z)(e <g> z) = e ® a;z. 

By abuse of notation, we will identify S with 7i- 

Finally, let = F(vA) be a quartic non-biquadratic CM number field with real qua- 
dratic subfield F. Let CAi(K) be the moduli stack over Z representing the moduli problem 
which assigns a base scheme S to the set of the triples (A, l, A) where i : Endg(A) 
is an CM action of Ok on A, and (A, l\o f , A) G A'l(S') such that the Rosati involution as- 
sociated to A induces to the complex conjugation of Ok- The map (A, i, A) i— > (A, t|o F , A) 
is a finite proper map from CAt(K) into A4, and we denote its direct image in Ai still 
by CAt(K) by abuse of notation. Since K is non-biquadratic, T m and CAi(K) intersect 
properly. A basic question is to compute their arithmetic intersection number (see Section 
H] for definition). We have the following conjectured intersection formula, first stated in 
|BYj . To state the conjecture, let $ be a CM type of K and let K be reflex field of (K, $). 
It is also a quartic non-biquadratic CM field with real quadratic field F = Q(V^D) with 
D = AA'. Here A' is the Galois conjugate of A in F. 

Conjecture 1.1. (Bruinier and Yang |BY] ) Let the notation be as above. Then 

(1.2) T m .CM(K) = l -b m 

or equivalently 

(1-3) (T m .CM(K)) p = ~b m (p) 
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for every prime p. Here 

p 

is defined as follows: 

(1.4) b rn (p)io g p = j2 E ^(p) 



Pip t= ™±^l ed - 1 ^ ) l n l <m ^ 



where 

(1-5) B*(p) 
and 



if P is split inK, 

(ord p t ra + I) p(td £ / pp' 1 ) log |p| i/p not split inK, 



p(a) = #{21 C O k : /V^2l = a}. 
Notice that the conjecture implies that T m -CAi(K) = unless 4Dp\m 2 D — n 2 for some 



integer < n < my D, in particular one has to have p < u . 

Throughout this paper, we assume that K satisfies the following condition — we call it 
condition (Jft): 

(1.6) 0jt = 0, + 0„H^ 

is free over Of and that D = A A' = 1 mod 4 is square free (w £ Of)- Under this 
assumption, one can show that d% = D 2 D, and dfr — D 2 D, and Nd^-^p = D. Here d& is 

the discriminant of K, and (i^/p is the relative discriminant of K/F. The main purpose 
of this paper is to prove the conjecture when m = 1, and to give a simple procedure for 
computing b\{p). 

Theorem 1.2. Under the condition (Jfr), Conjecture li.il /io/ds /or m = 1. 

We prove the theorem by computing the local intersection (CM.{K).T) p and bi(p) at 
given p separately and comparing them. On the geometric side, to a geometric intersection 
point l : Ok ^ End(£7) <8> Of we first associate a positive integer n, a sign p = ±1, 
and a 2 x 2 integral matrix T(pn) with det T(pm) = D ~ n £ 4pZ >0 (Proposition 14. 3p . 
Next, we use Gross and Keating's beautiful formula [GKJ to show the local intersection 
index at the geometric point i is equal to |(ord p + 1), depending only on T(fxn), not 
on the geometric point itself (Theorem 14. 5p . Practically, the local intersection index i is 
the largest integer m this action can be lifted to W/p m where W is the Witt ring of F p . 
The independence on the geometric points is essential and leads us to a simpler problem of 
counting the number of geometric points i : Ok ^ End(-E)®(9p whose associated matrices 
is T(/j,n), which is a local density problem representing T(pn) by a ternary integral lattice. 
Explicit computation for the local density problem is given in |Yalj and |Ya2j, but the 
formula at p = 2 is extremely complicated in general. We circumvent it in this special case 
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by switching it to similar local density problem with clean known answer in Section [51 and 
obtain the following intersection formula. 

Theorem 1.3. Let the notation and assumption be as in Theorem M.B, and letp be a prime 
number. Then 

(1.7) {Tx.CMiK))^ 1 - (ord p ^^ + l)J2^P,H, 

0<n<\/£>, %^SpZ>o 

where 

f3(p,fm) = Y[ Pi(P,^ n ) 

,\ D-n 2 
'I AD 

D-n 2 



is given as follows. Given a positive integer < n < y D with ~™ E pZ>o as in 
fli. 7\ ), there is one sign \i — ±1 (both signs if D\n) and a unique positive definite inte- 
gral 2x2 matrix T(fin) sc 
T{fin) is GL 2 (Z/)- equivalent 
ordj T(fm) — 2 ord; 2. Then 



gral 2x2 matrix T(fin) satisfying the conditions in Lemma \4-l\ For a fixed prime I, 

i D—n- 



T(fxn) is GL 2 (Z;)- equivalent to diag(«/,a / 1 det T(/in)) with ol\ E Z*. Let ti = ord; D 



Izt^Sl ifl=p, 
ft(p,pn)={ i±(zi)!i if I ^p, (-^,1)^-1, 
ti + 1 ifl^p,(-a h l)i = l. 

The theorem has the following interesting consequence. 

Corollary 1.4. Assume (Jfr) and D < 8D. Then T\.CAi{K) = 0, i.e., there is no elliptic 
curve E such that E ®Of has CM by Ok- 

In Section [6], we compute b\{p) and show that it equals twice the right hand side of (11. 71) 
and thus prove Theorem 11.21 From the definition, it is sufficient to prove an identity for 
each positive integer n with D ~™ E pZ >0 . After some preparation, one sees that the key is 

to relate whether K/F is split or inert at a prime [ to the local property of T(fin) at prime 
I — InZ. We prove this unexpected connection in Lemma I6\2"| and finish the computation 
of bi (p) in Theorem 16.31 

It is worth noting a mysterious identity underlining the conjecture. On the one hand, it 
is clear from our proof and a general program of Kudla |Ku2] that the intersection number 
is summation over some Fourier coefficients of the central derivative of some incoherent 
Siegel-Eisenstein series of genus 3. On the other hand, it is clear from [BY] that b m (p) 
comes from summation of certain Fourier coefficients of the central derivative of incoherent 
Eisenstein series on Hilbert modular surface. Viewing this identity as an identity relating 
the two seemingly unrelated Eisenstein series, one can naturally ask whether it is a pure 
accident, or there is some hidden gem? 

Now we briefly describe an application of Theorem 11.21 to a conjecture of Colmez, which 
is a beautiful generalization of the celebrated Chowla-Selberg formula. In proving the 
famous Mordell conjecture, Faltings introduces the so-called Faltings height ^p a i(^4) of an 
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Abelian variety A, measuring the complexity of A as a point in a Siegel modular variety. 
When A has complex multiplication, it only depends on the CM type of A and has a 
simple description as follows. Assume that A is defined over a number field L with good 
reduction everywhere, and let uja £ A 9 Qa be a Neron differential of A over Ol, non- 
vanishing everywhere, Then the Faltings' height of A is defined as (our normalization is 
slightly different from that of [Coj ) 



(1.8) h Va} (A) = — V log (— ) 9 f 
K } Fal1 ; 2[L:Q1 S W J a 



a{u A ) A a(u A ) 



+ log#A 9 n A /0 L u A . 



Here g = dim A. Colmez gives a beautiful conjectural formula to compute the Faltings 
height of a CM abelian variety in terms of the log derivative of certain Artin L-series 
associated to the CM type |Coj . which is consequence of his product formula conjecture of 
p-adic periods in the same paper. When A is a CM elliptic curve, the height conjecture 
is a reformulation of the well-known Chowla-Selberg formula relating the CM values of 
the usual Delta function A with the values of the Gamma function at rational numbers. 
Colmez proved his conjecture up to a multiple of log 2 when the CM field (which acts on 
A) is abelian, refining Gross's |Grj and Anderson's [Ad] work. A key point is that such CM 
abelian varieties are quotients of the Jacobians of the Fermat curves, so one has a model 
to work with. When the CM number field is non-abelian, nothing is known. Conjecture 
II. 1| together with \BY\ Theorem 1.4], would prove Colmez's conjecture for non-biquadratic 
quartic CM fields, confirming the first non-abelian case. More precisely, let K be a non- 
biquadratic CM number field with totally real quadratic subfield F = Q(y/D). Let x be 
the quadratic Hecke character of F associated to Kj F by the global class field theory, and 
let 

(1-9) A(s, X ) = C{x)^- s - l T{ S -±^) 2 L{s, x) 

be the complete L-function of \ with C(x) = DNf/qoIk/f- Let 

y ,A ' r(i) A(o, x ) 

In this case, the conjectured formula of Colmez on the Faltings's height of a CM abelian 
variety A of type (K, $) does not even depend on the CM type $ and is given by (see 

m\) 

(1.11) h m (A) = \(5{K/F). 

In Section [3, we will prove using Theorem 11.21 and |BYI Theorem 1.4]. 

Theorem 1.5. Let K be a non-biquadratic CM quartic CM field of discriminant D 2 D with 
D = 5, 13, or 17, and D = 1 mod 4 prime. Then Colmez's conjecture U.ll\) holds. 

Theorem 11.21 also has implications for Lauter's conjecture on the denominator of Igusa 
invariants at CM points and bad reduction of CM genus two curves in the special cases 
D = 5, 13, and 17. To keep this paper short, concise, and to the point, we omit this 
application and refer the reader to [Ya4j for this application, where we prove Conjecture 
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11.11 under the condition ( 11. 6p and that D = 1 mod 4 is a prime. The idea is to prove 
a weaker version of the conjecture for T q when q is a prime split in F = Q(\AD) (up to 
a multiple of log 9), and then combining it with |BY| Theorem 1.4] and HHK. Theorem 
4.15] to derive the general case. Although the proof of the weaker version is similar to the 
case m = 1 in this paper in principle, the argument is much more complicated and needs 
new ideas. The first difficulty is that instead of simple Endo F (E <g> Op) = End(E) <8> Op, 
Endo F (A) does not have a good global interpretation. So we have to work locally in terms 
of Tate modules and Dieudonne modules. Second, the local density problem is no longer 
a problem representing one matrix by a lattice. Instead, it is really a local Whittaker 
integral. We have to use a totally different method to compute the local integral. 

Here is the organization of this paper. In Section[2], we give basic definition for arithmetic 
intersection and Faltings' heights in stacks, following |KRY2j . We also show that 7i is 
isomorphic to the stack of elliptic curves. In Section [31 we briefly sketch a proof of Theorem 
11.21 in the degenerate case D — 1, which is also a new proof of the Gross-Zagier formula on 
factorization of singular moduli [GZlj . In Section HI we use a beautiful formula of Gross 
and Keating [GKj to compute the local intersection index of 71 and CM (K) at a geometric 
intersection point. In Section [5j we count the number of geometric intersection points of 
71 and CM (K) and prove Theorem 11.31 In Section [6j we compute b\ (p) and finish the 
proof of Theorem 11.21 In the last section, we prove Theorem 11.51 
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2. Basic definitions 



We basically follow [KRY2| Chapter 2] in our definition of arithmetic intersection and 
Faltings' height on DM-stacks which have a quotient presentation. 

Let M be a regular DM-stack of dimension n which is proper and flat over Z. Two 
cycles Z\ and Z?, in M of co-dimensions p and q respectively with p + q = n intersect 
properly if Z\ D Zi = Z\ Xm Z2 is a DM-stack of dimension 0. In this case, we define the 
(arithmetic) intersection number as 
(2.1) 

^ = E E #AuiM lo s#^n^„ = E E #AutM^ (Zl ' Z2 ' x)log?J 

where Oz x nZ2,x is the strictly local henselian ring of Z\ fl Z% at x, 

i p (Z 1 ,Z 2 ,x) = Length 6 Zin z 2 , x 
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< 6 z ,f>M= — < h,f>x 



is the local intersection index of Z\ and Z% at x. If 4> : Z — > Ai is a finite proper and flat 
map from stack Z to Ai, we will identify Z with its direct image <p*Z as a cycle of A4, by 
abuse of notation. 

Now we further assume that its generic fiber M = Aic — [T\X] is a quotient stack of a 
regular proper scheme X, where T is a finite group acting on X. Let 

pr : X -> M 

be the natural projection. We define the arithmetic Picard group Pic(A4) and the arith- 
metic Chow group CH (Ai) as in |KRY2l Chapter 2]. For example, let Z 1 (M) is R- vector 
space generated by (Z,g), where Z is a prime divisor in Ai (a closed irreducible reduced 
substack of codimension 1 in Ai which is locally in etale topology by a Cartier divisor), 
and g is a Green function for Z = Z(C). It means the following. Let Z = pr _1 (Z) be the 
associated divisor in X. Then the Dirac current 5z on M is given by 

1 
#T 

for every C°° function on M with compact support (i.e., every T- invariant C°° function on 
X with compact support). A Green function for Z is defined to be a T- invariant function 
g for Z. In such a case, we also have naturally 

dd c g + 8z = [w] 

as currents in M for some smooth (1, l)-form u on M — a T-invariant smooth (1, l)-form 
on X (see |KRY2l (2.3.11)]). Although n — 1 is assumed in |KRY2j . the same argument 
holds for all n. For a rational function / e Q(Ai)*, one defines 

div(/) = (div/,-log|/| 2 )GZ 1 (M) 

Then CH (Ai) is the quotient space of Z l (Ai) by the K- vector space generated by div(/). 
There is a natural isomorphism 

Pic(M) = CH^M), 

which is induced by C = (C, \\ \\) !->■ (divs, — log ||s|| 2 ), s is a rational section of £. Given 

a finite proper and flat map (j) : Z — > Ai, it induces a pull-back map 0* from CH (Ai) to 

CH (iJ), and from Pic(A'l) to Pic (Z). When Z is a prime cycle of dimension 1 (codimension 
n — 1), and £ is a metrized line bundle on AI, we define the Faltings height 

(2.2) h t (Z) = deg((j)*£) 

where is the natural embedding of Z to Ai. Here the arithmetic degree on Pic(Z) is 
defined as in [KRY21 (2.18) and (2.19)]. In particular, if s is a (rational) section of L such 
that div s intersects properly with Z, we have 

(2.3) h t (Z) = Z. div S - 1^ IK*) 1 1 
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where Z = Z(C). Equivalently, in terms of arithmetic divisors, 

(2.4) h [Zl , gi) {Z) = Z X .Z + l - # AutOs) ^' &>3i)tCn\M) 

if Z\ and Z intersect properly. The Faltings height is a bilinear map on CH (Ai) X 
Z n ~ 1 (M), which does not factor through CH n_1 (.M). 



Now come back to our specific case. Let F = Q(v_D) be a real quadratic field with 
D = 1 mod 4 being prime. Let Ai be the Hilbert modular stack over Z defined in the 
introduction. It is regular and flat over Z but not proper QDPj ). Let Ai be a fixed Toroidal 
compactification of .M, then .Mc and Aic have quotient presentation (e.g., Ai(C) = 
[T\Y(N)] with F(iV) = r(A^)\H 2 , and T = T(iV)\ SL 2 (£>f) for N > 3)- Let K = F(V&) 
be a non-biquadratic quartic CM number field with real quadratic subfield F, and let 
CAt(K) be the CM cycle defined in the introduction. Notice that CAi(K) is closed in Ai. 
K has four different CM types $i, $2, p&i — {p°~ '■ °~ G ^i}; an d p ( &2 ) where p is the 
complex conjugation in C. If x = (A, i, A) G CM(.?0(C), then (A, 6, A) is a CM abelian 
surface over C of exactly one CM type $j in .M(C) = SL 2 (CV)\IHI 2 as defined in |BYl 
Section 3]. Let CM(if, <3>j) be set of (isomorphism classes) of CM abelian surfaces of CM 
type (K, $«) as in [BY], viewed as a cycle in Ai(C). Then it was proved in [BYJ 

GM(K) = CM(K, $i) + CM(K, $ 2 ) = CM(K, p$ x ) + CM(K, p$ 2 ) 

is defined over Q. So we have 

Lemma 2.1. One has 

CM(K)(C) = 2CM(K) 

inM(C). 

Next, recall that the Hirzebruch-Zagier divisor T m is given by |HZ] 

T m (C) = SL 2 (O f )\{( Zi , z 2 ) G H 2 : (z 2 , 1)A ( z {) = for some A G L m } } 

where 

L W = {A = (*, x b ) : a,&GZ,AG<9 F \^-AA' = -}. 

T m is empty if (— ) = —1. Otherwise, it is a finite union of irreducible curves and is actually 
defined over Q. In particular, Ti(C) is the diagonal image of modular curve SL 2 (Z)\H in 
M{C). Following [BBK] , let T m be the flat closure of T m in Ai. 

Lemma 2.2. Let £ be the moduli stack over Z of elliptic curves. Let <fi : £ — > Ai be given 
by 4>(E) = (E eg) Of, if, Af) for any elliptic curve over a base scheme S, where 

l f :O f ^ End 5 (£) <g> O f = End 0s ®o F ( A ) C End 5 (A) 

is i/ie natural embedding, and 

X F : dp 1 -»■ Homo^tgiC^E®^ 1 )^™, A F (z)(e® ar) = e ® xz. 

T/ien cf) is a closed immersion and 4>{£) = 7[- 
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Proof. It is known [BBK, Proposition 5.14] that is a proper map and its image is 7i- To 
show it is a closed immersion as stacks, it is enough to show 

lsom(E,E') S Jsom{<f>{E), <f>{E?)), f ^ 4>(f). 

Clearly, if / : E — > E' is an isomorphism, (f)(f) is an isomorphism between (j)(E) and <j)(E'). 
On the other hand, if g : 4>{E) — > <p{E') is an isomorphism, i.e., g : E <8> Op — > E' <8> C?p is 
an (9p-isomorphism such that 

(2.5) g y o \ F (r) o g = \ F (r) 

for any r G d^ 1 . Taking a Z-basis {1, 1± ^-} of O f , we see E'® % O f = (E'®1)®(E'®±±^-), 
and that (7 is uniquely determined by (for any e £ E and 2 G Cf) 

g(e ®x) = a(e) ®x + (3(e) <g) - ~1T~~ X 

for some a(e),(3(e) G -E", which is determined by g. This implies that a and /3 are homo- 
morphisms from E to E' . Let a v , /3 V , and g w be dual maps of a, /3, and g, then (for any 
e' G and 1/69^ = (£> F ) V = Hom z (C F , Z)) 

^(e'®y) = a v (e')®y + /3 v ^5z/. 

Here we used the simple fact that with respect to the bilinear form on F, (x,y) = trxy, 
the dual of an ideal a is a -1 dp 1 , and the left multiplication l(r) is self-dual: Z(r) v = l(r). 
Taking r = 1, and x — 1, we have then for any e G E 

e® 1 = # v A F (l)c/(e® 1) 

= 0>(e)®l + / 9( e )®I±^5) 

= a v a(e) ® 1 + /3 v a(e) ® + a v /3(e) ® + ^ (1+^5)2 

Zi & £ 

= (dega + deg/3^— — )e ® 1 + (/3 v a(e) + a v /3(e) + deg/3) ® 1 + . 
This implies 

1 = dega + deg/3 — - — . 

So dega = 1 and deg/3 = 0. This means that a is an isomorphism, = 0, and g = 
0(a). ' □ 

Let to be the Hodge bundle on M.. Then the rational sections of u k can be identified 
with meromorphic Hilbert modular forms for SL 2 (Op) of weight k. We give it the following 
Petersson metric 

(2.6) \\F( Zl ,z 2 )\\ Pet = \F(z l ,z 2 )\(l67r 2 y 1 y 2 ) k/2 
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for a Hilbert modular form F(z) of weight k. This gives a metrized Hodge bundle Cj = 
(cj, j| 1 1 p c t ) . Strictly speaking, the metric has pre-log singularity along the boundary M.—M., 
[BBKJ. Since our CM cycles never intersect with the boundary, the Faltings' height 

ha(CM(K)) — deg(0*a)) 

is still well-defined where : CAi(K) — > M. is the natural map. Indeed <fi*Cj is an honest 
metrized line bundle on CAi(K) as defined here. Faltings's height for these generalized 
line bundle is defined in |BBK] (for schemes) which is compatible with our definition when 
applied to stacks. It is proved in |Ya3] that 

(2.7) h*{CM(K)) = 2# ™ ( ^V ai(A) 

for any CM abelian surface (A, l, A) G £M(C). This will be used in Section [7] to prove 
Theorem 11.51 

3. The degenerate case 

In this section, we briefly sketch a proof of Theorem 11.31 in the degenerate case D = 1 
(F = Q © Q) which is a reformulation of Gross and Zagier's work on singular moduli to 
illustrate the idea behind the proof of of Theorem 11.31 It also gives a new proof of the 
Gross-Zagier formula on factorization of singular moduli [ GZ1 , Theorem 1.3]. Let Aii be 
the moduli stack over Z of elliptic curves, Let Ai = M.\ x M. 1 be the modular stack over 
Z of pairs of elliptic curves. In this case, T\ is the diagonal embedding of M.\ into M.. 
Let Ki = Q(^/di), i — 1, 2, be imaginary quadratic fields with fundamental discriminants 
di < and ring of integers Oi = Z[ di+V ^ ], and let K = K\ ®K 2 . For simplicity, we assume 
di = 1 mod 4 are prime to each other. Let CAi(Ki) be the moduli stack over Z of CM 
elliptic curves (E, Li) where 

(3.1) Li : Oi C O e = End{E) 

such that the main involution in Oe reduces to the complex multiplication on Oi. Then 
CM(K) = CM(Ki) x CM(K 2 ) is the 'CM cycle' on M associated to K. It is easy to see 
that 

Tx.CM(K) = CM{K x ).CM{K % ) in M x 
(3-2) = — kgWrO-jfa)! 

dlSC[TiJ=Oj 

where Wi = #0* and n are Heegner points in A^i(C) of discriminant di. So |GZ1| Theorem 
1.3] can be rephrased as 

Theorem 3.1. (Gross-Zagier) Let the notation be as above, and let D = d\d 2 - Then for 
a prime p, one has 

(3.3) {Ti£M{K)) v = \ (ord p ^^ + l)/3(p,n), 

D-n 2 
4 
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where 

f3(p,n) = | [ /3i(p,n) 



i\ 



D-n 2 
4 



is given by 




ifl^p,e(l) = l. 



where ti = ord; " , and 



e(l) 




is as in 



Proof, (sketch) The proof is a simple application of the Gross-Keating formula |GK] . A 
geometric point of 7i fl CM.{K) = Ti X-m CM.(K) in F = F p or C is given by a triple 
(E, tj, t 2 ), with CM action given by (13. ip . Since (d\, d 2 ) = 1, such a point exists only when 
.F = F p with p nonsplit in Ki and F is supersingular. Assuming this, Oe is a maximal 
order of the unique quaternion algebra B ramified exactly at p and oo. Notice that the 
reduced norm on B gives a positive quadratic form on B, and let ( , ) be the associated 
bilinear form. Let </>o = 1, (f>i = k{ di+ ^ )-, then is determined by 0j. Let 

T(0 O ,01,02) = ^((0i,0j)) 

be the matrix associated to three endomorphisms 0«. Then a simple computation gives 
(3.4) T(0 o ,0i,0 2 ) = | f | | diag(l, T(n)) ( | 




,0 



with n = 2(0!, 2 ) — -D and 

(3-5) = 



It is easy to see that G Z >0 (since the quadratic form is positive definite). In general, 



for an integer n with D ~" e Z>o ; let T'( ?7 -) be the 3x3 matrix defined by the right hand 

side of d33]). If 0i e C B with O = 1 satisfies T(0 o ,0i,0 2 ) = T(n), then ^(^^) = ^ 
gives actions of Oi on F and thus a geometric point (E, t 1? t 2 ) in the intersection. By |GK[ 
Proposition 5.4], the local intersection index i p (E,ix,L 2 ) of 7i and CAi(K) at (E,ii,i 2 ) 
depends only on T(0 O , 1; 2 ) an d is given by (see Theorem 14.51 and its proof for detail) 

1 D-n 2 

(3.6) i p (E, n, l 2 ) = 7r( ord P z 1- !)■ 
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( Tl .CM(K)) r = ^ £ (ord,^ 



4 SA>0 



Es.s. 



#01 



with 



f (n)) = #{0i, 2 G 0£ : T(l, 1; 2 ) = f (n)}. 



The summation is over isomorphic classes of all supersingular elliptic curves over ¥ p . Next, 
notice that for two supersingular elliptic curves E\ and E 2 , Hom(Ei,E 2 ) is a quadratic 
lattice in B, and they are in the same genus (as Ei changes). Simple argument together 
with \GK\ Corollary 6.23, Proposition 6.25] (see Section [5] for detail) gives 

^ R'(Q E ,f(n)) = R(0 E ,f(n)) 



Es.s. 



Es.s. 

E 

E u E 2 s.i 

P(p,n) 



R(Hom(E 1 ,E 2 ),f(n)) 



Here 



R(L, T(n)) = #{0i, 2 , 03 G L : T(0 1; 2 , 3 ) = T(n)} 
is the representation number of representing T{n) by the quadratic lattice L. So 

D — n 2 



(T\.CM{K)) P = i £ (ord p 



2 ' 4 

D-n 



+ l)/3(p,n). 



Notice that f3 p (p,n) = when p f — j 2 - by the formula for f3 p (p,n). So the summation is 



really over 



D-n 2 



G pZ>o- This proves the theorem. 



□ 



In the degenerate case, it is reasonable to view K = Q(y/di, y/cfa) as the reflex field of 
K = Q{Vck) © Q(v^2) with respect to the 'CM type' $ = {1, a}: 

v{\fd~U \fih) = (V^2; V«l)> ^{\fd 2 , V^l) = ( — V^lj V^)- 

.K" has real quadratic subfield F = Q("\/d) with Z) = d 2 d 2 . Using this convention, one can 
define b m (p) and b m as in Conjecture 11.11 We leave it to the reader to check that 

D — n 2 

h i(v)= (oid p ^— + l) (3(p,n), 



and thus T\.CM.{K) = \b\. This verifies Conjecture 11.11 for the degenerate case D — 1. 
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Lemma 4.1. Let F = Q(v-D) be a real quadratic field with D = 1 mod 4 prime. Let 
A G Of be totally negative and let D = AA'. Let n be an integer < n < \ft) with 

D t ^>0- 

(a) When D \n, there is a unique sign fi = fi(n) = ±1 and a unique positive definite 
integral matrix T(/in) = (g G Sym 2 (1j) such that 

D-n 2 

(4.1) detr(H = — ^— , 

(4 2) A = 2 fJ ,n-Dc-(2b + Dc)VD 

Moreover, one has 

D 2 -D 

(4.3) a + L>6 H c = -/in. 

When D\n, for each fi = ±1, there is a unique positive definite integral matrix 
T(fin) = (I b c ) G Sym 2 {Ij) such that fl^.lp and /io/d. In eac/i case, /io/ds. 

Proo/. Write A = 2±|^ ; then w 2 - v 2 D = AD, and so 

u 2 = 4Z) mod -D = 4n 2 mod .D. 

This implies D\(u — 2n)(u + 2n). 

(a) Since D \ An is prime, there is thus a unique /x = ±1 and unique integer c such 
that 

u = 2fin — Dc. 

Since A is totally negative, u < 0. So « 2 > AD > An 2 , and so u < 2fin, and c > 0. ( I4.2p 
also gives b = ~\ Dc = + jjn G Z. Next, (14. ip gives a unique a G Q>o, and T(/in) > 0. 
We now verify that a is an integer by showing that it satisfies (14. 3p . The equation (14. Xp 
gives 

4£>ac - 4L>6 2 = AD - An 2 = -v 2 D - 2uDc - D 2 c 2 . 



So 



and so 



4ac = -Dc(Ab + Dc) - 2(2fm - Dc)c - Dc 2 
= —ADbc - D 2 c 2 + Dc 2 - A/in, 



, D 2 — D 

a + Db-\ c = — an 

A 



as claimed in (14. 3p . 

(b) When D\n, D\u. So for each \i = ±1, there is a unique integer n such that 
u = 2 fin — Dc. Everything else is the same as in (a). □ 

Remark 4.2. Throughout this paper, the sum ^ means either ^u=±i when D\n or the 
unique term /i satisfying the condition in Lemma 14.11 when D \ n. 



(4.5) T(x x ,x 2 , • • ■ ,x n ) = - ((xi,Xj)) £ Sym n 
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Let E be a supersingular elliptic curve over k = ¥ p . Then Oe = End(-E) is a maximal 
order of the unique quaternion algebra B ramified exactly at p and oo. Let 

(4.4) L E = {x £ Z + 20 E : tr x = 0} 

be the so-called Gross lattice with quadratic form Q(x) = xx = —x 2 , where x t- y x is the 
main involution of B. The reduced norm gives a quadratic form on B. For x\,x 2 , - ■ ■ ,x n E 
B, we define 

1 

2 

Proposition 4.3. Let the notation and assumption be as in Theorem M .2\ Letp be a prime 
and E be a supersingular elliptic curve over ¥ p with endomorphism ring Oe- Then there 
is a one-to-one correspondence among the following three sets. 

(1) The set 1(E) of ring embeddings i : Ok ^ End OF (E ® Op) = Oe®Of satisfying 

(a) i(a) — 1 <S> a for a £ Op, and 

(b) the main involution in Oe induces the complex conjugation on Ok via i. 

(2) The set T(E) of (5, (3) £ L\ such that T(5, 0) = T([iri) for some integer < n < 

\J~D such that £ P^>o and a unique /J, — ±1. 

(3) The set T(E) of (aoj/?o) £ 0\ such that T(l,ao,/?o) = T(fxn) for some integer 
< n < \[~D such that %7=p £ P^>o and a unique fi = ±1. Here 

(I 0\ /l a a\ 1 1 

f= » | diag(l,T) | = Mf i(« + w o) ^b + wow,] 

W o §y \o o ±y \f k & +«) |(c+< 

for T = T(/m). Here w = w + W\ D+ /® is given in U.6\) . 
The correspondences are determined by 

(4.6) i( ) = a + (3 , 

(4.7) L (VA) = 5 + ( 3^/°, 

(4.8) 5 = 2a - w , (3 = 2(3 - Wl . 

Proof. Given an embedding i £ 1(E), we define a , (3 , 5 and (3 by ( 14. 6 p and ( 14. 7p . They 
satisfy flU}, and (5,(3) £ L\. Write T(5,(3) = ( a b b c ) with a = \(6,6) = -5 2 , b = \(5,f3), 
and c= \((3,(3) = -(3 2 . First, 

A = i(A) = l(^) 2 = (6 + |/3) 2 -(5+ ^, ±p)yfD 

D 2 + D 1 
= -a-Db — c - (b + -Dc)Vd. 

4 v 2 ; 



We define n > and = ±1 by 



™ ^ 2 " D 
-fin = a + Db H c. 
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Then 

A _2fm- Dc- (2b + Dc)y/D 
~ 2 

satisfying (14. 2p in Lemma 14.11 Now a simple calculation using D = A A' gives 

D — n 2 

det T(5, (3) = ac-b 2 = 

satisfies (I4.ip . So T(5,(3) = T(fin) for a unique n satisfying the conditions in Lemma [4.11 
To show p\ det T(«n), let 

1 = (5,(3) + 25(3 eL E . 

Then 

(5,7) = (0,7) = 0, (7,7) = 2(8,5)(0,/3) - 2(5, P) 2 = 8detT(/m). 
So the determinant of {5, f3,y} is 

det T(5,/3, r y) = det diag(T(/in), 4 det T(fxn)) = 4 det T(fxn) 2 . 

Since has determinant 4p 2 , we have thus p| det T(fin). To show 4| det T(/m), it is easier 
to look at T(iin) G Sym 3 (Z) v (since a , (3 G O^;)- It implies that 

(4.9) a = —wl mod 4, 6 = — woWi mod 2, c = — w 1 mod 4. 

So det T (fin) = ac — b 2 = mod 4, and therefore (5, /3) G T(£"). A simple linear algebra 
calculation shows that (a , (3 ) G T(E). 

Next, we assume that (5, (3) G T(E). Define i and (a , (3 ) by (14. 7p and (14. 8p . The above 
calculation gives 

so t gives an embedding from .K" into B <8> Op satisfying the conditions in (1) once we verify 
l(Ok) C Oe <8> Op, which is equivalent to «o, A) £ Cs- Write 

5 = -w + 2ai, /3 = -Mi + 2f3 1 , u = u + u 1 ^-^-~ 
with Mj G Z, or, /?i G 0£. Then 

l( ^— ) = "i + ft ^— C? F . 

This implies that G 0*. On the other hand, G O k . So ^ G F , i.e., 



G Z, and 



a Q = a l + G O e , Po = ft + G £> B 

as claimed. So (a 0) Ad) £ T(-E') and i G /(-E). Finally, if (a , (3 ) G T(-E'), it is easy to check 
that (5, (3) G T(E). □ 

The proof also gives the following interesting fact. In particular, Corollary 11.41 is true. 
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Corollary 4.4. Let K be a non-biquadratic quartic CM number field with real quadratic 
subfield F = Q(\/~D) where D does not need to be a prime. If Ok is a free Op-module 
as in ( li.fij) with D = AA' < 8D (not necessarily square free or odd). There is no elliptic 
curve E such that E £g> Op has an Ox-action whose restriction to Op coincides with the 
natural action of Op on E ® Op. 

Proof. If such an CM action exists, E has to be a supersingular elliptic curve over F p for 
some prime p. Let i be the resulting embedding i : Ok ^ Op® Op. The main involution 
of B induces an automorphism of K which is the identity on F. Extending this through 
one real embedding a of F, we get an embedding i : C ^ B <g) R, which is the division 
quaternion algebra over R. Then main involution has to induces the complex conjugation of 
C and thus K. Now the same argument as above implies that there is an integer n > such 
that G p%>o- Since D is not a square (K is not biquadratic), one has D ~£ > p > 2, 
i.e., D > 8D, a contradiction. □ 

We are now ready to deal with local intersection indices of 71 and CM. (K) at a geometric 
intersection point. In view of Lemma [2.2[ we consider the fiber product 



(4.10) CM(K)x M £^^S 



CM(K) f -^M 

An element in CM{K) x M £(S) is a tube (E, A, l, A) such that (A, i, A) G CM{K)(S) 
E G £{S) satisfying 

A = E (g) Op, i\o F = If, \ = \f 
where i p and A p are given in Lemma 12.21 This is determined by 

l : O k Op® Op 

with l G 1(E). So an intersection point x — (E <g) Of, lf, \f) £ CM.(K) fl T\(S) is given 
by a pair (E, i) with t G I(-E). When S* = Spec(F) for an algebraically closed field F = C 
or F p , such an pair exists only when F = F p and E is supersingular. Assuming this, and 
write Z = CM(K) n 7i- Let be the Witt ring of F p , and let E be the universal lifting 
of E to and let I be the minimal ideal of W[[t]] such that i can be lifted to an 

embedding 

ij : O k End(E mod J) <g> C F . 
Then the deformation theory implies the strictly local henselian ring Oz, x is equal to 

O z>x = W[[t]]/L 

So 

(4.11) i p (CM(K),T h x) = Length w W[[t]]/I, 
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which we also denote by i p (E, l). Therefore 

(4-12) (CM(K).Ti) p = J2 ^Th(E,i)\ogp. 

Here 's.s.' stands for supersingular elliptic curves. Notice that Aut(x) = Aut(-E) = 0* E by 
Lemma [2 .2[ The local intersection index i p (E, l) can be computed by a beautiful formula 
of Gross and Keating [GK] as follows. 

Theorem 4.5. Let the notation be as above, and let (S, (5) G T(E) be the image of i G 1(E), 
and let T(/j,n) = T(5,(3) as in Proposition \4-3[ Then 

1 D - n 2 
i p (E,i) = -(or d P AD + 1) 

depends only on n. 

Proof. Let (ao, A)) G T(n) be the image of l. First notice that / is also the smallest ideal 
of such that a and (3 can be lifted to endomorphisms of E mod /. Applying the 

Gross-Keating formula [GK[ Proposition 5.4] to fi = 1, / 2 = a , and / 3 = (3 , we see that 
i p (K, l) depends on the GL 3 (Z p )-equivalence class of T(fin) and is given as follows. 
Let a® < a\ < a 2 be the Gross-Keating invariants of the quadratic form 

(4.13) Q(x + ya + z(3 ) = (x, y, z)f(fxn)(x, y, zf 

defined in |GK| Section 4]. Then i p (E,i) equals 

oo-l (oo+oi-2)/2 

^2(i + l)(a + a 1 + a 2 - 3i)p i + (a + 1) (2a + a x + a 2 - Ai)p* 

i=0 i=a.Q 
a + 1 , , "Q+°l 

H g — ( a 2-ai + l)p 2 

if ai — ao is even, and 

ao-l (oo+oi— 1)/2 

+ l)(a + ai + a 2 - 3i)p l + ^ (a + l)(2a + ai + a 2 - 4i)p 4 
if ai — a is odd. 

First assume that p is odd. In this case, T(fin) is GL 3 (Z p )-equivalent to diag(l, T(fin)). 
Notice that p \ T(fin), T(/in) is GL 2 (Z p )-equivalent to diag(a p , a" 1 det T(fin)) for some 

a p G Z*, so T(iin) is equivalent to diag(l, a p , a" 1 det T(ixn)). So the Gross-Keating invari- 
ants are (0, 0, ord p det T(/j,n)) in this case. The Gross-Keating formula gives 

1 1 D — n 2 

ip(E,t) = -(ord p det T(/in) + 1) = -(ord p — + 1). 

Now we assume p = 2. Since the quadratic form Q associated to T(/j,n) is anisotropic 
over Q 2 , T(/j,n) is GL 3 (Z 2 )-equivalent to either 

diag(e 2\2 s V 2 )) or diag(e 1 2 tl , e 2 2* 2 , e 3 2 is ) 
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with 6i G Z2 and ti, s G Z>o- Since T(fin) is not integral over Z2 (at least one of wq or w± 
is odd), T(fxn) has to be GL 3 (Z 2 )-equivalent to diag(e 2'°, {y 2 ^l)- 111 this case, [Ya2l 
Proposition B.4] asserts that the Gross-Keating invariants are (0,0, to)- Since 

1 ID — n 2 
3e 2*°- 2 = det T(an) = —detT(un) = , 

we see £ = or d2 ^n=r- Now the Gross-Keating formula gives the desired formula for 
p = 2. "' □ 

We remark that when p 7^ 2, the ideal I is also the minimal ideal such that S and f3 can 
be lifted to endomorphisms of E mod /. It is not true for p = 2. In summary, we have 
our first main formula. 

Theorem 4.6. Let the notation and assumption be as in Theorem \1.2 . Then 

^ 5-»2_„ A* Es.r L 



0<n<VA- 4D 



where R(L,T) is the number of a lattice L representing T, i.e., 

R{L,T) = # {x = (x h x 2 ) G L 2 : T{x u x 2 ) = T) . 
Here the meaning ofJ2^ ^ s given in Remark \JJ^ 

5. Local Density 

It is not hard to prove that the quantity ^2 Es s R ^ L ^^ n ^ is product of the so-called 

local densities. Explicit formulae for these local densities are given by the author in [Yall 
Propositions 8.6 and 8.7] for p 7^ 2. When p = 2, an algorithm is given in |Ya2] and could 
be used to get a formula in our case, but it is cumbersome. We give an alternative way to 
compute it in this section. We first prove 

Lemma 5.1. Let T G Sym 2 (Z) and let T be obtained from T by the formula in Proposition 
W${3). Assume f G Sym 3 (Zy . Then 

R(L El T) R(Hom{E,E'),f) 

Es.s. " h E,E's.s " hTr E 

Here Hom(E, E') is equipped with the degree as its quadratic form. 

Proof. Clearly T(S, (3) = T if and only if T(l, a , (3 ) = T where 5, (3, a , and (3 are related 
by (EE}. The condition f G Sym 3 (Z) v implies that {5, p) G L% if and only if (a , Po) G 0%. 
Next if fx, f 2 , / 3 G Oe represents T, i.e., T(fx, f 2 , fa) = T, then the reduced norm Nfx = 1, 
and fx G 0* E . In such a case, 1, ao = fx hi 0o = fx l fs represents T too. So 

R(0 E ,f) = #0 E R(L E ,T) 
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and 

v-^ R{Le, T) _ sr R(Q E ,f) 

Es.s " b Es.s v " 

On the other hand, if fx, fz, h £ Hom(£, E') represents T, then deg/i = 1 and f% is 
actually an isomorphism. So i? (Horn (E,E'), T) = unless i£ and E' are isomorphic. This 
proves the lemma. □ 

The quantity 

R(Eom(E,E'),f) 



is also a product of local densities and is computed by Gross and Keating \GK\ Section 6] 
in terms of Gross-Keating invariants (see also |We2] and |Wel] for more extensive expla- 
nation) . More precisely, we have (note that det Q in |GK] is our det 2T) , 

E,E's.s Eii E ppdetf 

Here P (T) is or 1 depending on whether T is isotropic or anisotropic over 7L V . For I ^ p, 
fli(T) is zero if T is anisotropic over Z/ and is given as follows if T is isotropic by \GK\ 
Proposition 6.24]. Let < a < a% < a 2 be Gross-Keating invariants of T, and let e = ±1 
be the Gross-Keating epsilon sign of T, then 
If ao = cii mod 2 and e = 1, we have 

a -l (ao+ai-2)/2 

=2^(i + l)Z* + 2 ^ (z + l)r + (a + l)(a 2 -a 1 + l)/^. 
If ao = cti mod 2 and e = —1, we have 

cio-l (a +ai-2)/2 

A(f) = 2]T(z + l)r + 2 ^ (* + l)f + (a + l)/^. 

i=0 i=«o 

If a ^ ai mod 2, we have 

ao-l (ao+ai-l)/2 

A(f) = 2 X)(< + 1)/* + 2 ]T (i + l)J*. 

Lemma 5.2. Lei n be a positive integer such that D ~™ 2 G Z >0 and /ei T(fxn) be as in 
Lemma \4-l\ Then 

(1) T(fin) is GL 2 (Z)/- equivalent to diag(a«, a^ 1 det T(fxn)) for some a\ G Z;. 
T(jin) is isotropic if and only if (—an, l)f = 1 where ti = ord/ D 4 ^ 2 . 
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Proof. (1) follows from the fact I \ a or I \ c. By (1), T(jin) is GL 3 (Q;)-equivalent to 
diag(l, ai, af 1 det T(fin)). So its Hasse invariant is (c^, — detT(/m))j. By (SeJ Chapter 4, 
Theorem 6], T(^in) is isotropic over Z; if and only if 

(a>i, - det T(nn))i = (-1, - det T(jj,n))i, 



i.e., 

D - n 2 



When Z ^ 2, 



When I = 2, Lemma [6.11 in the next section asserts that either a = — 1 mod 4 or c = — 1 
mod 4. So «2 = a or c, and thus — a 2 = 1 mod 4. This implies 

Z) — n 2 , 
( ~" 2 ' 4D~ )2 = (~ a2 ' 2 )2 ■ 

just as in the odd case. □ 

Proposition 5.3. Assume that < n < \ft) with € £>Z >0 . Tnen 

^ R{L E ,T(fin)) n , . 

Es.S " E l\D-rfi 

l l 4D 

Here 0i(p, /in) zs aii>en as follows. Let T(fxn) be GL 2 (Z/) -equivalent to diag(«/, af 1 det T(/m)) 
over Zi with ai E Z* ; and wzie U = ordz D 4 ^ 2 . Then 

ifl = P, 

0i(p,fin) = { ±±t^l ifl^p, and (-a l ,l) l = -1, 

ifl^p, and {-a h l)i = 1. 

Proof. By Lemma loTTI and fl5.ll) . it suffices to verify the formula for (3i(p, n). The case I = p 
follows from Lemma [5.21 

When / \ 2p, T(/m) is GL 3 (Z;)-equivalent to diag(l, T) and thus to diag(l, ai, a~[ l det T(/m)). 
When it is isotropic, its Gross-Keating epsilon sign is (— ati,l)i by definition Gl\l Section 
3]. So its Gross-Keating invariants are (0,0,^), and when it is isotropic, its Gross-Keating 
epsilon sign is (— ai, l)i by definition [GKl Section 3]. Now the formula follows from Lemma 
15.21 and the Gross-Keating formula described before the lemma. 

Now we assume I = 2 ^ p. Since T(fin) Sym 3 (Z 2 ), T(ftn) is GL 3 (Z 2 )-equivalent to 




diag(e2* 2 ,( i ; 2 1 / 2 )), A = 0,1. 



It is isotropic if and only if A = or A = 1 and t 2 is even. In each case, the Gross-Keating 
invariants are (0,0, £2) by |Ya2[ Proposition B.4]. In the isotropic case, the Gross-Keating 
epsilon sign is 1 if A = and — 1 if A = 1 by the same proposition. We claim that A = 
if and only if (— a 2 ,2) 2 = 1, i.e., a 2 = ±1 mod 8, i.e., the Gross-Keating epsilon sign of 
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T(fj,n) is again (— 02,2)2. Indeed, Lemma EH] implies that a = 3 mod 4 or c = 3 mod 4. 
Assume without loss of generality a = 3 mod 4. In this case wq = 1 mod 2 and we can 
take «2 = a - It is easy to see that T(/xn) is Z 2 -equivalent to 

(I I Hi 

I « l(b + w 1 ) 

a 1(6 + |(c + «;?) y 

with a = |(a + 1) G Z 2 . 

If (—a, 2)2 = 1, i.e., a = 7 mod 8, and so a = e2 r for some r > 1 and e G ZJj. Let /?i 
and /3 2 are roots of x 2 + x + a = with f3\ G and (3 2 G 2 r Z?;, and let L = ©Z 2 ej be the 
lattice of T. Let 

h = e 2 + /Siei, / 2 = e 2 + /3 2 e 2 - 
Then it is easy to check that (/1, / 2 ) = —1 + 4a and (/1, /1) = (/2, /b) = 0. This implies 
that L = (Z2/1 + Z2/2) © Z2/3 for some ^3 G L. So T and thus T(/in) is Z 2 -equivalent to 

1/2 \ ^ „tax 



diag((^ f), ei 2« 



If (—0,2)2 = — 1, then a = 3 mod 8 and a G Z^. In this case, it is easy to check by 
calculation that L = Z 2 ei © Z 2 e2 © Z2/3 for some /36I perpendicular to ei and e%, and 
its quadratic form is 

Q(xei + ye 2 + zfe) = x 2 + xy + ay 2 + dz 2 

with d = Q(f3), and is thus Z 2 -equivalent to x 2 + xy + y 2 + d\Z 2 . So A = 1. This proves 
the claim. The claim implies that the formula is also true for I = 2. 

□ 

Proof of Theorem 11.31 : Now Theorem 11.31 is clear from Theorem 14.61 and Proposition 

El 

6. Computing 6i(p) and Proof of Theorem 11.21 

The formula for bi(p) is known to be independent of the choice of the CM type $. We 
choose $ = {1, a} with a(y/E) = v^. Then K = F(V~K) with 

(6.1) A = (Va + Va*) 2 = A + A' -1\/~b. 

For an integer < n < y^D, let \x and T(fin) = ( g be as in Lemma [4.11 Then we have 
by Lemma 14.11 

(6.2) A = 2//n - Dc- 2\f£) 

2 



Lemma 6.1. Assume the condition (Jfc). For an integer < n < V D with " G Z>o- 
/ei and T(fin) = ( g be as in Lemma \4-1\ Then 

(1) One has Mn ^^ G — and ~ lin ^^ G d^=, — C F . i/ere ' stands for the 

Galois conjugation in F . 
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D D " 2 , p\a or p\ c. 



(2) For any prime p 

(3) Exactly one of a and c is mod 4 and the other is — 1 mod 4. 
Proof. (1): When D\n, one has D\D, and dp-^p = d'p.p and the claim is clear. When D \ 



n. 



one has 



±n+y_D 
2D 



^ Op, and 
D-n 2 



n + VD -n+VD 



4 2 
So there is a unique v = ±1 such that 



EDZ = d k/ pd' R/ p. 



un + w D 



G d', 



-vn + V -D 



if/F' 



G a^-/^. 



On the other hand, A & d k ,p implies fin — y D E d%-,p. So (/i — z/)n G dgyF and thus 
(/i — v)n = mod D. So /i = za Now it is easy to see 



fin + V D 
2D 

(2): If p\a, c, then p\ac — b 2 



-tm+VD y 

2D $ d k/F u f- 



D-n 2 
D 



p\n 



implies p\b, and thus 

, D 2 -D , 
-via + Db^ c) 



This implies p\D. But this causes a contradiction: p 2 \ac — b 2 = D ~" . 

(3): Since K/F is unramified at primes of F over 2 under the condition (Jit), there are 
integers x and y, not both even, such that 



A = (x + y 



Y mod 4. 



By Lemma [4.11 this implies 



s, D 2 -D 1 
- a = (D + l)b : c - Dc- 



4 

So (since D = 1 mod 4) 

(6.3) 
(6.4) 



y —r- + (y + — o — 



a + x 2 + 26+ — — -(c + y 2 )=0 mod 4, 



(6.5) 



2xy + y 2 + c = mod 4. 
When x is even, y has to be odd. So c = — 1 mod 4 and a is even. Since 

Z? - n 2 



ac — b = det T(fxn) 



D 



mod 4, 



mod 4. 



one has a = mod 4 and 6 = mod 2. 

When x is odd and y is even, (16.31) . (16 .4p . and (16. 5p imply a + 1 = c = mod 4. 

When both x and ?/ are odd, (16 .4p implies c = 1 mod 4. So (16.31) implies that a is odd 
and thus b is odd. Now (16.51) implies a = 1 mod 4 and that 6 is odd. So (16. 3p implies 
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D = 1 mod 8. But this implies that —[in = a + Db + D2 ~ D c is even, which is impossible 
since D is odd. So this case is impossible. □ 

It is easy to see from the definition that b\(jp) = unless there is n > with D 7^ € p1*>o. 
This implies in particular p is split in F or p\D is ramified in F. For a fixed n > with 
D 4 ^ 2 G pZ, >0 , fix a sign /i = ±1 such that T(fxn) exists as in Lemma H~T1 In the split case, 
we choose the splitting pO F = pp' such that 

(6-6) U = 6 

So 

Z) - n 2 

(6.7) ordp ^ n = ordp ^ , ordp/(^ n ) = or - 1. 

In the ramified case pO F = p 2 , the above two equations also hold (forgetting the one with 
p'). With this notation, we have by (jl.4p 

(6.8) b 1 (p)= Yl (ovd p ^^ + l)J2KP^n) 



where 

(6.9) b(p, //n) 



if p is split in K, 

p(^n^x/Fp _1 ) if P is not split in K. 



Assume now that p is not split in K. Notice that 

[ 

where the product runs over all prime ideals I of F, and 

if I is ramified in K, 
(6.10) ftCVk/i*- 1 ) = { 1 +(- 1 )° rd " t ;"^ /#P " 1) if l is inert in K, 

1 + ord[(^ n (i i ^^p~ 1 ) if I is split in K. 

Notice first that Pi^t^d^/pp^ 1 ) = 1 unless ord^t^rf^^p -1 ) > 1. In particular it is 1 

unless 1 1 where / is the prime under 1. So we assume that l\ B ^ ■ This implies that 

either l\D is ramified in F or I = 11' is split in F. In the split case, we again choose the 
splitting lOp = 11' so that 



i D — n 2 det T(jj,n) 
(6.11) ordi^d^p -1 ) = ord/ ^ = ord; — , ord[- <(t ^ n d k / pp' 1 ) = 0. 
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Lemma 6.2. Let the notation be as above. Assume I 7^ dp-jp and that T(/in) is GL 2 (Z;)- 

equivalent to diag(az, aj l det T(/in)) with cx\ G Z*. Then K/F is split (resp. inert) at I if 
and only if(—ai,l)i = 1 (resp. —1). 

Proof. Since 1 7^ dp^jp, 1 is either split or inert in K. We first take care of a very special 
case 1 = d 1 ^^ 7^ dp-^p. In this case, I — D \ n. So 

A = 2/j.n — Dc — 2y/15 = 2/in — 2\ft) = A/in = -4a modi 

So I \ a, and K = F(y^K) is split at I if and only if (—a, l)i = 1. In this case cti = a. 
Now we can assume I 7^ D. We divide the proof into three cases and more subcases. 
Case 1: First we assume that l\D is ramified in F. In this case, lOp = I 2 , l\n, and 

A = 2fm — Dc — 2\ft) = —Dc modi. 

Since ord/ D 4 ^f = 1, it is easy to check I \ c and thus A ^ mod 1. Since A A' = Dv 2 , 
one has 

A 2 = Dv 2 mod 1 

and 

1 = — Acv 2 mod I. 

So K = F(VK) is split at 1 if and only if (— c, l)i = 1. Notice that a\ = c in the case. 

Case 2: Next we assume that I \ 2D. So I is split as discussed above. In this case, either 
If A or If (A)'. 

Subcase 1: We first assume If A. Since t M „ e 1, one has 

A = 2/in — Dc — 2\ft) = 4/in — Dc mod 41 = —a mod 41 
with a = 4a + ADb + D 2 c. So over F\ = Qi, one has 

(A,Z), = (-a,Z),. 

So (—a, l)i = 1 (resp. —1) if and only if K/F is split (resp. inert) at I. On the other hand, 

(?4i)t(h(d4i) =(?:), 

T(fin) is GL 2 (Z ; )-equivalent to diag(a, a -1 det T(/xn)). 

Subcase 2: We now assume If A'. Since AA' = -Dt> 2 for some integer v, we see that 

(A,/), = (A', /),(£>, J),. 

On the other hand, 

A' = 2//n- J Dc + 2v^/5= -Dc mod 41, 

one sees that (A, l)i = (— c, /); and I \ c. Since T(/in) is GL 2 (Z;)-equivalent to diag(c, c -1 det T(/in)) 
in this case, the lemma is true too. 

Case 3: Finally, we deal with the case / = 2. When 2 \ c, the same argument as 
in Subcase 2 above gives the lemma. When 2|c, the situation is more complicated and 
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technical. First, ac — b 2 = D = mod 8 implies that 4|c and 2\b. We choose the 
splitting 2 = 11' as in floUTD . 

Subcase 1: If c = 8ci = mod 8, then b = 4&i = 4 and 

A _ an + \/J) 
-— = -an + 2Dd + - — 

2 /jlu + y~D 



= a + ADbi + 2D z a + 
^ mod [. 



Notice that 
(6.12) 

So K = F( 
that 



,x + y V D, 2 



, x — any . 9 un 



y 



,D-n 2 



2 / v 2 / * 2 4 
A) is split at [ if and only if there is x+y }^ e Op with x and y odd such 



A 



,x + yv -D. 



mod 41, 



i.e., 



a + ADb x + 2£> 2 ci + y ; 



,L>-n 2 



+ 



,x — finy 2 



+ (xy + 1 



mod 41. 



Notice that 



D-n 2 



D{2ac\ — 4o 2 ). So K = F(\ A) is split at [ if and only if there are 



odd integers x and y such that 

a + AD(h - bj) + 2D Cl (D + a) + + {xy + 1) ^^ = mod 41. 



That is 



a+( — ^) 2 + (x?/ + 1)- = mod 41, 



2 / 2 

since .D + a = mod 4 and — /m = a mod 4. In particular, one has to have x + ay = 2 
mod 4, and thus xy = —1 mod 4 (recall that a = — 1 mod 4). So the above congruence 
is equivalent to 

. x + ay , 9 , , „ 

o + ( — ^) 2 = mod 41, 

i.e., (—0,2)2 = 1. So K/F is split if and only if (—0,2)2 = 1- 

Subcase 2: Now we assume that c = 4ci with c\ odd. In this case, b = 2b\ with 61 odd, 
and 4 = mod I, not easy to deal with. We switch to A'. We have 



(6.13) 



A' jin + \/D 



Dc x ^ mod I 
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Since A A' = Dv 2 if A = h+£y^ K = F(VK) = F(VdA') is split at [ if and only if there 
is odd integers x and y such that 

da' _ x+jr/5 2 _ 

— = ( 2 ^ = m ° 

By (16.121) and (16.131) . this is equivalent to 

-ci = ( ) + D{aci - bi) + (xy - D) - mod 41. 

Since 

-a + ci + D(a Cl - b\) = D(a + l)(ci - 1) + (D - l)(a - ci) + D(l - 6?) = mod 41, 
the above congruence is equivalent to 

(6.14) -a= C ~^ ny y + ( gy - D / + ^ mod 41. 

In particular, x ~^ n?/ has to be odd. Since 

-/m = a + 2Db x + (D 2 - D)a =a + 2 mod 4, 
this means = mod 2, and thus xy = 1 mod 4. So (16.141) is equivalent to 

—a = ( ) mod 41. 

Therefore, K/F is split at I if and only if (—0,2)2 = 1. This finally finishes the proof of 
the lemma. □ 

Theorem 6.3. One has 

(6.15) b 1 (p)= Yl (ord p ^^ + l)^/3(p,^), 
where /3(p,pn) is given as in Theorem M.'d 

Proof. The discussion between Lemma 16.11 and Lemma 16.21 gives (I6.15P with 

b(p,fin) = Y[k(p,fm). 

1 

Here for I 7^ p 

k(p,n) = Ylpiitf.ndjc/FP' 1 )- 

l\i 

For I = p, pOp = dx/pd'^.p. Write p = d'^.,p, then 

if p split in K, 

Ppit^ndK/pp' 1 ) if p not split in K. 



b P (p,pn) 



When I \ . " , one has clearly bi(p, p,n) = 1. 
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When I = p, 



b p (p, fin) 



if p is split in K, 



tc-i 



if p is not split in K, 



= 1 - (-a p ,p) P p 
2 

= P (p, fin) 

as claimed. 

When l\ D 7p , but I ^ p, I is split in F or l\ D is ramified in K, In the split case, we 
choose the splitting lOp = 11' so that (16. lip holds, and Pvitndpjpp -1 ) = 1. In either 
case, bi(p,p,n) = Pi^n^x/^P -1 )- Now Lemma 16721 and (16. lQf) give the desired formula for 
bi{p, fin). n 

Proof of Theorem 11.21 Now Theorem 11.21 follows from Theorems 11.31 and 16.31 



7. Proof of Theorem 11.51 

A holomorphic Hilbert modular form for SL 2 (Of) is called normalized integral, if all its 
Fourier coefficients at the cusp oo are rational integers with greatest common divisor 1. 

Lemma 7.1. Assume D = 5, 13 or 17. Then for every integer m > 0, there is a positive 
integer a(m) > and a normalized integral holomorphic Hilbert modular form \l/ m such 
that 

div^ m = a(m)T m . 

Proof. Let S^D, (—)) be the space of elliptic modular forms of weight 2, level D, and 
Nebentypus character (— ) such that its Fourier coefficients satisfy a(n) = if (— ) = — 1. 
Then a well-known theorem of Hecke asserts dim S^D, (—)) = for primes D = 5, 13, 17. 
By a Serre duality theorem of Borcherds [Bo2] and Borcherds's lifting theorem |Bol] (see 
|BB] in our special setting), there is Hilbert modular form ^> m such that div\l/ m (C) = T m 
and sufficient large power of \l/ m is a normalized integral Hilbert modular form. Replacing 
\I/ m by a sufficient large power if necessary we may assume that ^ m is a normalized integral 
holomorphic Hilbert modular form. So div\l/ m is flat over Z and thus div\l/ m = a{m)T m - 

□ 

Proof of Theorem 11.51 Let Co = (u, || ||p e t) be the metrized Hodge bundle on M. with 
the Petersson metric defined in Section [2J Let 7i be the closure of 71 in M.. Let be 
a normalized integral Hilbert modular form of weight c(l) given in Lemma [7. 11 Then 
can be extended to a section of co c ^\ still denoted by \I>i such that 



div^ = a(l)7~i. 
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Since CM(K) never intersects with the boundary M - M, f\.CM(K) = Ti-CM(K). So 
c(l)ht a (CM(K)) = bk^ 9i) (CM(K)) 

= a{l)CM{K).T 1 -^ r Yl log||*iWI|pct 

K z£CM(K) 



by Theorem 11.21 and |BYl Theorem 1.4]. It is not hard to check that 

W K = W k 



10 \iK = K 
2 otherwise. 



Let M = KK be the Galois closure of K (and K) over Q, view both Xk/f anc ^ Xk/f as 
characters of Gal(M/F) and Gal(M/F) respectively by class field theory. Then 

71 ~ ind Gal(M/F) XK/F - inCl Gal(M/F) XK/F 

is the unique two dimensional irreducible representation of Gal(M/Q) when K is not cyclic 
(when K is cyclic, the identity is trivial). So 

l ( s ,Xk/f) = l ( s ,Xk/f) = L(s,ir), 

and thus /3(K/F) = f3(K/F). Finally, [BY] (9.2)] asserts 

2#CM(if) 
A ^Xk/f)= Wr ■ 

h ,iCM m =*^l m/F) . 
Wk 

Combining this with (12. 71) . one obtains 

(7.1) h Fal (A) = l^K/F). 

This proves Theorem 11.51 
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